A systematic evaluation of payback of publicly funded health and health services research in Hong Kong

BACKGROUND The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour. METHODS A locally suitable questionnaire was developed based on the "payback" evaluation framework and was sent to principal investigators of the completed research projects supported by the fund since 1993. Research "payback" in six outcome areas was surveyed, namely knowledge production, use of research in the research system, use of research project findings in health system policy/decision making, application of the research findings through changed behaviour, factors influencing the utilization of research, and health/health service/economic benefits. RESULTS Principal investigators of 178 of 205 (87%) completed research projects returned the questionnaire. Investigators reported research publications in 86.5% (mean = 5.4 publications per project), career advancement 34.3%, acquisition of higher qualifications 38.2%, use of results in policy making 35.4%, changed behaviour in light of findings 49.4%, evidence of health service benefit 42.1% and generated subsequent research in 44.9% of the projects. Payback outcomes were positively associated with the amount of funding awarded. Multivariate analysis found participation of investigators in policy committees and liaison with potential users were significantly associated with reported health service benefit (odds ratio [OR]participation = 2.86, 95% confidence interval [CI] 1.28-6.40; ORliaison = 2.03, 95% CI 1.05-3.91), policy and decision-making (ORparticipation = 10.53, 95% CI 4.13-26.81; ORliaison = 2.52, 95% CI 1.20-5.28), and change in behavior (ORparticipation = 3.67, 95% CI 1.53-8.81). CONCLUSION The HHSRF has produced substantial outcomes and compared favourably with similar health research funds in other developed economies. Further studies are needed to better understand the factors and pathways associated with the translation of research findings into practice.